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ABSTRACT 

Brief, impromptu essays written for the 1990 
administration of the College Board's English Composition Test (ECT) 
were randomly sampled for four groups of examinees. These essays were 
subjected to further holistic ratings beyond those conducted for the 
ECT, and analytical ratings were also obtained. The holistic scores 
were correlated with the analytical scores to determine which essay 
characteristics were most closely associated with high holistic 
scores. Results indicated that overall organization, use of 
supporting materials, noteworthy ideas, rhetorical strategy, and the 
thesis statement were the strongest correlates. Comparisons with the 
results of a study of 1979 essays on a different topic showed that 
the same characteristics were associated with high scores in that 
administration. These characteristics correlated strongly with high 
holistic scores for all subgroups and for males and females. Other 
factors associated with higher scores, studied only in 1990, were 
completion of the task, use of a standard essay format, use of 
literary references, and proficiency in the English language. Certain 
types of content were also associated with higher scores. Four 
appendixes present the essay topic, the rating form and instructions, 
supplementary ratings, and selected examples. (Contains 15 tables and 
6 references.) (Author/SLD) 
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Abstract 

Brief, impromptu essays written for the 1^90 adminis- 
tration of the Clollegc Board's Hnglish C'omposition Test 
(H(T) were randomly sampled for four different groups 
o) examinees. These essays were subjected to further 
holistic ratings beyond those conducted for th(‘ HCT ad- 
ministration, and analytical ratings were also obtained. 
The holistic - cores were correlated with the analytical 
scores to determine w'hich essay characteristics \sere 
most closely associated with high holistic scores. The re- 
sults indicated that overall organization, use of sup- 
porting materials, noteworthy ideas, rhetorical strategy, 
and thesis statement were the strongest correlates. Com- 
parisons with the results of a previous stud\‘ of 1979 
HCT essays, written on a different topic, showed that 
these same characteristics were also most closeb' associ- 
ated with high holistic scores in that study. These char- 
acteristics correlated strongK' with high holistic scores 
for all subgroups rar jomly sampled, and for males and 
females. 

.\ddirional factors associated with better holistic 
scores hut studied only for the 1990 topic included fol- 
lowing instructions, completion of the task, use of a 
standard essay format, use of literary references, and 
proficiency in the Hnglish language, 

C.’ertain types of essay content were also associated 
with higher sc'orcs on the 1990 topic. Hssays combining 
current affairs with literature and history or combining 
literature and history received slightly higher scores on 
average than essays based only on current affairs, liter- 
ature, history, or personal experience. Ne\'ertbeless, 
some essays receiving high scores were based solely on 
personal experience, did not contain literary references, 
and did not use a standard essay format. The analyses 
suggest that some practice with this type of brief, im- 
promptu essay, particularly under strict time con- 
straints, may be useful as preparnion for raking such 
essay examinations. 



Intioduction 

Previous research has identified some characteristics 
that relate to performance on brief, impromptu essays 
(Breland Jones, 1982; Breland & l.ytle, 1990), but 
this research has been far from thorough. The in- 
creasing interest in performance testing, which often 
translates into essay testing, has been accompanied by 
increasing interest in identifying the characteristics of 
essays that are viewed positively and negatively h\ the 
readers who score them. What do teachers of Hnglish 



believe to be good practice in the writing of brief, im- 
promptu essays? Are desirable practices for these kinds 
of essays the same as for writing more generally? What 
information should he provided to teachers and stu- 
dents to enable them to optimally prepare for brief, im- 
promptu essay rests? Should special information be pro- 
vided to members of ethnic minority groups or to 
women? 

Partial answers to some of these questions i.avc 
been provided by previous research. Breland and Jones 
( 1982) examined samples of ' ,^says written for the De- 
cember 1979 administration of the Hnglish Composi- 
tion Test (HCT). Hrom the 85,542 essays written at 
that administration, randcim samples of 200 were 
drawn from each ni the following groups: African 
American/black students, Hispanic students with Hng- 
lish as their best language, Hispanic students who re- 
ported that Hnglish was tint their best language, and 
white students. The black and white student samples 
were restricted to studcius who reported that Hnglish 
was their best language. 

In the 1982 study, Hducational Testing Service 
(HTS) humanities test development staff, w'ith assistance 
from outside consultants who were experienced readers 
of HCT essays, developed a list of 20 characteristics 
considered important in evaliiating brief, impromptu es- 
says. A group of experienced Hnglish teachers rated the 
sampled essays with respect to each of the 20 charac- 
teristics, with tw(> teachers rating each essa\ indepen- 
dent! \‘. Both positi\'e and negative charaeteristics were 
rated. The ratings obtained were then correlated with 
holistic scores assigned by a different set of readers 
during the regular scoring of the HCT. 

The correlational analyses showed that the li\e 
luost important correlates of high holistic scores were 
overall organization (r = .72), u.w of supporting mate- 
rials (r = .*^1), noteworthy ide.is (r = .*^0), rhetorical 
strategy (r = .66), statement of diesis (r = ,64), and para- 
graphing and transition (;'= .5”) (see Table 15, page 1 ^). 

A number of compariso. ; of group differences were 
also made in the Breland and Jones (1982) study. In 
order of importance, the strongest correlates with high 
holistic scores tor each group were as follows: black 
sample: overall organization, statement of thesis, 
rhetorical strategy, and use of supporting materials; 
Hispanic (Hnglish first language) sample: use of sup- 
porting materials, overall organization, rhetorical 
strategy, statement of thesis, and noteworthy ideas; His- 
panic (Hnglish flat first language) sample: overall orga- 
nization, range of vocabulary, subjcct/verb agreement, 
statement of thesis, and rhetorical strategy; and white 
sample: overall organization, use of supporting mate- 
rials, noteworthy ideas, rhetorical strategy, and state- 
ment of thesis. These comparisons suggest that while all 



k‘M- groups tLMuled to exhibit similar probliMns in their 
writing, the Hispanic (English nor first language) group 
had special problems relating to language proficiency. 

Another approach to determining what characteris- 
tics of brief essays relate to high holistic scores is to con- 
duct computer analyses of the essa\'s. Breland and Lytle 
( 1990) conducted such analyses of one of the essays in- 
cluded n a Breland, (^amp, Jones, Morris, and Rock 
{198*^) study. This was an expository essay of the type 
used on the ECT, but 45 minutes was allowed for 
writing instead of only 20 minutes as on the EC’T. The 
computer analysis “flagged" specific attributes of stu- 
dents' writing: passive verbs, “to be" \ erbs, sub * t-verb 
disagreements, “fu/zy" words, run-on scntep.;.-.s, dan- 
gling participles, spelling errors, capitalization errors, 
and punctuation errors. The number of flags for each 
attribute was divided by the word count for the essay to 
develop an error rate for each attribute. These error 
rates were then correlated with the holistic score for the 
essay. The correlations (in parentheses) were as follows: 
passive verbs (.15), “to be" verbs (.00), subject-verb dis- 
agreements (-.26), fuz/y words (-.07’), run-on sentences 
1 datigling participles (-.29), spelling errors (-.25 g 
capitalization errors (-.04), and punctuation errors 
(. 00 ). 

The zero or non-negative correlations suggest either 
that the computer analyses were imperfect in detecting 
>Lich errors or that these errors i.lid not sigr*(^cantly in- 
fluence the scoring of the essays sampled. Both the 
rating procedures used in the Breland and Jones ( 19(S2) 
study and the computer analyses used in the Breland 
and l.ytle ( 1990) study indicate that some useful lessons 
can be derived from such analyses that may be of in- 
terest to teachers who haw the task nor only o\ teaching 
students how to write in general bur also of providing 
guidance on how to write for specific types of examina- 
tions that their students may be required to take. 

The purpose of the present investigation was to ex- 
amine some of the same essay characteristics studied 
previously, as well as to look at additional factors, to 
determine what advice might be offered to teachers and 
examinees about essay writing j^racrices. 

Method 

Sampling 

hollowing the data collection design used in the Breland 
and Jones (1982) study, stratified random samples of 
100 each of .African American/black, Hispanic, Asian 
American, and white students were drawn from the ex- 



aminees who sat for the December 1990 administration 
of the Ecrr. 

Instrument 

The essay topic and instructions for the 1990 E(T with 
essa\‘ are reproduced in Appendix A. 

Data Collection Procedures 

Essa\' scores and S.AT-verbal (Sr\^-V), ESWl*. (Test of 
Standard Written English), EC!T Objective, and E.C.T 
Reported scores were obtained from program files for 
the cases sampled. A special analytical reading of the 
same essay responses was conducted using the rating 
form and the instructions shown in Appendix B. A 
holistic score on a scale from 1 (low) to 6 (high), the 
same scale used in the original essay scoring, was ob- 
tained for each essay using the raring form along with 
22 analytical \‘ariables scored on a scale from 1 (low) to 
5 (high). Two readers, working independently following 
train-ing, completed the rating form. Of the 15 readers 
engaged, 9 were female and 6 male. 

In addition to the ratings done using the Appendix 
B form and instructions, a further set of supplementary 
ratings of the essays was completed by an English 
teacher, not among the 15 readers who used the Ap- 
pendix B form and instructions, working as an indi- 
vidual consultant to the project (see Appendix (.). In- 
cluded in these additional ratings were the appearance 
of each essay (neatness, legibility, etc.), the number of 
paragraphs used, whether paragraphs were properly in- 
dented, and other information not obtained in the orig- 
inal analytical ratings. 

Analyses 

Means and standard deviations were computed for each 
variable, for each of the four groups randomly sampled, 
for males and females, and for the samples combined. 
I he mean difference between white/Asian American, 
white/black, white/fLspanic, and male/female groups 
was computed for each variable. C.'orrelation coeffi- 
cients were computed between the total holistic essay 
score (the original programmatic holistic score obtained 
for the Admissions Testing Program (ATP) program ad- 
ministration of the test plus the special holistic score ob- 
tained in this study) and all continuous variables for 
each group. 

Mean differences were computed for a number of 
dichotomous \ariables de\eloped from the supplemen- 
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tary ratings (c.g., W'crc* instructions followed? W as the 
essay completed? Hid the writer have a language 
problem? Were literary references used? Were para- 
graphs properly indented?). .Mean differences were 
also computed for a number of categorical variables 
developed from the supplementarv ratings (e.g., 
essa\- content, essay type, political orientation of the 
writer, handwriting style). Nhiltiple regression analyses 
were conducted to determine winch \ariables con- 
tributed most in the prediction of the total holistic 
score. 

C.Omputer anabses the sample essa\s were c ''*- 
ducted using Writer's W'orkbench software iCdierry, 
19SI), and the \ariables derived from these analyses 
were correlated with the total holistic sc(M‘e. 

Fin.dlv, three types of exemplary essa\s were iden- 
tified: ( 1 ) essax's with the highest total lK)listic set^res, (2> 
essavs with substantially higher total holistic sct)res 
than predicted b\ the regressions, and (.V* essays with 
substantially lower total holistic scores than predicted 
b\ the regressions. 1 hese exemplars weiX' examined lo 
determine what factors might hav e been particulaiix' im- 
portant in scoring these special cases. 

Results and Discussion 

Mean Differences for Gender and 
Etlniic Groups 

1 he means for all variables developed, and for each 
group analyzed, arc shown in Table 1. Standard devia- 
tions are presented in I able 2. 1 he 1 able I means for 
SAT-\' show that all groups were somewhat above av- 
erage m verbal skills. The SAF-\' average sct)re for all 
college-bound seniors in was 424, with male^ av- 
eraging 42'“^ and females 41^^ (C.ollege Bt)ard, '. 

I hus the male average of 4S I in the present sample w as 
52 points above the male college'bt)und senior average 
for and the female average t)f 445 was points 

higher than the female college-bt)und senior average for 
'I'lw .-\sian American sample (with an average of 
441) was points abiwe the national college-bt)und 
senior average, the black sample (with an average of 
4~4) xvas 50 points above the national average, the 1 lis- 
’"»anic sample (with an average of 460) was 36 pt)ints 
above the national average, and the white sample (with 
an average of 524 1 was lO'v points above the national 
average. 

The mean differences between males and females, 
and between whites and ethnic minorities, are shown 
in Table 3. The gender differences all favored females 
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minority groups were statisritally sijL»niHeoiir and ta- 
\orcd white examinees. The lari;est etfect si/es (dil- 



terences in standard deviation units) occurred be- 
tween the white and Hispanic samples, where the 
greatest differences occurred for TSWH, the ECT Ob- 
jective score, and the ECT Reported score. Effect sizes 
less than .20 are considered to be “small," however, re- 
gardless of their statistical significance (C'ohen & 
Cohen, I9<S3). 

Ot the ratings, the largest effect sizes occurred for 
organization (for all three ethnic miiK^rity groups). 
Asian examinees averaged lower ratings than white ex- 
aminees on thesis statement, trans .ion, organization, 
development, and subject/verb agreement. Black exami- 
nees averaged lower than white examinees on thesis 
statement, rhetorical strategy, noteworthy ideas, sup- 
port, transition, tone, sentence logic, organization, de- 
velopment conclusion, active/passive voice, and lan- 
guage. Hispanic examinees averaged lower ratings than 
white examinees on thesis statement, rhetorical 
strategy, noteworthy ideas, support, tone, sentence 
logic, organization, development, conclusion, precision 
of diction, and language. Black and Hispanic examinees 
averaged lower ratings on neatness and numher of 
words written. 

Correlations 

Table 4 presents correlations between total holistic 
essay scores and the other \'ariables. For benh males and 
females, the highest correlations occurred for organiza- 
tion (.74 and -7.T respectively), followed closely by 
number of words written (.72 and .71, respccri\'ely). 
Other \ ariables that eorrelated highly with total holistic 
scores for males and females included support, note- 
worthiy ideas, thesis statement, rhetorical strategy, tran- 
sition, tone, sentence logic, paragraphing, development, 
and precision of diction. 

The correlations by ethnic group differed more than 
those by gender. The strongest correlates with total 
essay scores tor Asian American examinees were orga- 
nization (.71 ), number ot words written (.70), transition 
(.“"O), noteworthy ideas (.69), support (.69), thesis state- 
ment (.6(S), and rhetorical strategy (.67). For black ex- 
aminees, the strongest correlates were number of words 
writteii (.69), support (.68), organization (.66), transi- 
tion (.61 ), conclusion (,.S7) and noteworthy ideas (..s6). 
For Hispanic examinees, the strongest correlates were 
organization (.74), number ot words written (.74), sup- 
port (.66), transition (.66), precision ot diction (.62), 
and paragraphing (.60). 'Total holistic scores for white 
examinees correlated most highly with organization 
(,^“*), support, (.^^), transition (.74), noteworthy ideas 
number ot words written (.7."^), development 
(.“'!), conclusion (.""O), thesis statement (.69), and 
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Correlations with Total Essay Scores 
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gani/ation, support, transition, notewonin ideas, and 
number ot words w ritten. 

Mam Differcticcs for 
Dichotomous Variables 

lable ^ shows tlut ti\e ol the dielioiomous \ariables 
de\ eloped Iroin the siip[dementar\ larin.us prodnee(.l 




statistically significant mean differences in total holistic 
scores. The three examinees w'ho did not follow’ in- 
structions received significantly lowx'r scores than those 
w’ho did. The 189 examinees who did not complete 
their essays in the 20 minutes allow'ed received signifi- 
cantly lower scores. Eight examinees w'ere identified 
who had an obvious problem with the E’nglish lan- 
guage; the\' received significantly low'er scores on av- 
erage than did other examinees. Fifty-nine examinees 
used what is knowm as a “standard essay format." That 
is, the essay was composed of four or five paragraphs, 
the first paragraph contained the introduction, the 
last a summary or conclusion, and the intermediate 
paragraphs discussed separate topics chat had been 
signaled in the introduction. Those examinees using a 
standard essay format received better scores on average 
than those w'ho did not (but other e\idence shows 
clearl)- that it was possible to recei\e a very high 
score irithoHt using a standard essa\' format). The 6i 
examinees who used a literary reference in their essays 
received better scores than those who ^Ed not, on av- 
erage (again, evidence to be presented later shows that 
literary references were not required to i.ceive high 
scores). 

Mean Differences for Categorical 
Variables 

lable b shows that essays classified in certain content 
categories received higher scores, on a\erage, than did 
essays in other categories. Essays that combined current 
affairs and literature, and those Uiat combined literature 
and histor\-, recei\ed the highest a\erage scores. Those 
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essays that combined current aHnirs and history also re- 
ceived above average scores. Essays on personal experi- 
ence (about a quarter of the essays sampled) received 
the lowest scores on average. Essays with political 
themes also received high scores, while those classified 
as "opinion" or "personal" received lower scores on av- 
erage. There was no significant difference in scores be- 
tween essays expressing liberal as opposed to conser\a- 
tive political leanings, but those expressing neither 
appeared to receive lower scores. Handwriting style — 
cursive, printing, or a combination of the two, made no 
significant difference in the scores received. 

To further explore the differences observed in Table 
6, some categories were combined and anabzed, as 
^hown in Table Essays based on personal experience 
were compared with two combinations of content. 
First, the use of personal experience was compared to 
essays based on current affairs, literature, or history 
alone, or on combinations of these; the difference ob- 
tained was statistically significant. A larger effect size, 
however, was obtained when essays on personal experi- 
ence were compared to essays based on innihiiuitions of 
current affairs, literature, or history. A third compar- 
ison shown in Table is between essays using current 
affairs, literature, or history alone and essa>s using 
combinations of current affairs, literature, or history. 
The essa\s with combined content recei\ed better a\- 
erage scores than those focusing on a single content cat- 
egor\ . Finally, Table " compares the combination of 
"opinion" atiei "personal" essays with the combination 
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Mean Differences for Combined Categories 
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of "didactic" and "political" essays, and shows that es- 
sa\s in the opinion/personal combination category re- 
cei\ ed significantly lower scores. 

Regression Analyses 

The regression analyses sh<nved that a considerable 
amount of the \ ariance in total holistic essay scores was 
explainable by the other variables developed. Table <S 
presents regression analyses for three different variable 
sets. The first variable set consisted of general charac- 
teristics, and as Table N shows, 8 of the 12 general char- 
acteristics rated made statistically significant contribu- 
tions to the prediction of total essay scores. The 
multiple correlation coefficient of .84, when squared, 
shows that these eight characteristics explained over 
two-thirds (TO) of the \ ariance in the essay scores. The 
beta weights indicate that the most important contribu- 
tors in this regression were support, transition, and or- 
ganization. 

The second variable set e. mined consisted of syn- 
tactic characteristics, and Table 8 shows that four of the 
six syntactic characteristics contributed significantly to 
the prediction. I his variable set yielded a multiple cor- 
relation of only .50, however, indicating that these vari- 
ables were less important in determining total holistic 
essav scores than were the general characteristics. The 
third variable set consisted of lexical characteristics, and 
as Table 8 shows, three of the five lexical eharacteristics 
rated contributed significantly to the prediction. I hese 
three lexical charaetcristics, interesiingb , \ielded a 
higher multiple correlation than did the svntactic char- 
aeterisiiLS i.hO versus .sOi. 
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Multiple Regression of T otal Kssas 
Different Variable Sets (N = 400) 
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lablc cxrciuls rlu* rhrcc wiri.iNc s^rs shn\\!i in 
Tiihic S to include number of v'ords wntren und SAT-\‘ 
and TS\\‘H scores. The first \\i rouble set is the result of 
combining <dl 22 ratings with the count of w’ords 
written. W'ords written added substantially to the mul 
tiple correlation, increasing It from .Ss to .‘■^0. CM the 10 
variables in this first variable set in Table words 
written made the most significant contribution (beta = 
.aS). The second variable set in Table inclikled SAT- 
\' and TSW'l* scores, in addition to number of words 
written. The 11 variables in this second set \ielded a 
multiple correlation of .‘•^l, only slightb’ higher than 
that achieved without including SAT-\’ and TSWT- 
scoi'.‘s. Note that the vocabulary rating in the first vari- 
able ^et failed to contribute to the second set, probabb 
because of the <iddition of SA l-\' scores, which include 
a vocabulary component. I’ven with all of these van 
ables included, the single most imporiani contribut<'r in 
th.e regression was number of words written (beta - 
. Mt). 

Table I (’f presents the results ol .in .uiabsis to de- 
termine the percent.ige of variance m essav sunes ac 
counted for In 10 sigiufNani conlributmg v.iri.dTes de 
rived from the iss.ivs themselves o.e., excluding SA ! A' 
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Multiple Regression of Total F.ssay Scores on the Three 
X'ariablc Sets Combined with Other X'ariabics (N= 400) 
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and T'SWT'. scores). The last column of T able |() shows 
the m era II percentage of variance accounted for h v 
these 10 significant variables (.81, the scpiare ol the 
multiple correlation). Table ID also shows the per- 
centage of variance accounted for by each of the vari- 
.ibles in the set. I')\ far, most of the variance in essav 
scores l2(S percent) was aecounred for hy number of 
wor;.ls written. Other major contributors were transi- 
tion (1 1 percent) and organization ( 10 pereeiui. 

r.iiTe 11 shows the results when three of the di- 
chotomous or categorical variables of particular interest 
were a;.ldeil to the regression. Vdiether the essav wms 
completed, whether a literarv reference was used, tiiul 
whether personal conreiu wms used were examined. 
When combined with .ill other predictors, essav com- 
pletion accounted for percent of the variance, making 
a literarv reference for 1 percent, and referring to per 
sonal Loniuit for 2 percent, l o determine vvhelh(‘r ihesr,- 
three vanaMes contrihnted significaiub hevoiid their 
iinp.Kt 111 Lonihiii.ition with tlu ollu-r vaii.iMts, the hi 
i i.ucliic.d leiu'essinii mefli(tds <»f ( oheii .Uid C idien 
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Percentage of V ariance in hssa\ Scores Accounted for b\ 
Different F.ssay Cdiaracteristics 
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; \\\Tc used, riu' squarc«.l multiple conel.uinn co- 

efhcieiit with the target \aria!">le added was enmpared 
with the squared multiple correlation coLdlicieiit 
without the target \anable. Tests ot sigmticana' showeil 
that both ess.u ctuiijdLtion and use ot p».isonal contLiit 
conirilnited sigmhcatuly at the .01 le.el, while iisi- ot a 
hierar\ retei'eiKe did not maki' a sigmlKant ».ontiilni- 
tu >11 be\ Olid that ot the other \ a rubles. 

C.omp liter Ana iys es 

lo pro\ ide e\eii greater i.leiail in the anabses ot the /e 
latioiisliip between ess«i\ ebara^. tiu istu s and total 
holistic scores, additional anabses vs ire conducted 
Using the Stvie program ot [he Writer's Worklunch 
( hens, \ tiital ot 1"' Stvie varubbs wei\ se 

leered tor analysis. The Workbench variables e\ehulevl 
tendevi to be llu^se that correlatevi highb with niimbei 
i)f wonls vsritten. these variables were exchidevl be 
cause the relationships between total h()lisHc scores and 
number ot vv orcb w niten had been anab /ed prev u uisb . 

Table 12 shows means tor i he 1^ Stvie variables 
aiul indicates statistically signituant mean dittereiiccs. 
Sr.indard de; laiioiis are giv en in table lv(bib two ot 
the Stvie varialdes vielded mean vhlterences between 
miles .ind teniaks signilk.int at the .0^ level. I lu ]hi 
ceiuage ot simple sentences iS\|Pl pi usevi was slightb 
higher tor nules than t(U' temales, an-J the percentage 
ot sentences biginnim; with verbs AIKIUM)' was 
slightb higher tor teinah's. It is not dear w bar nuanmg 
might be att. idled to these diMeieiices. e\o pi ilut llu 
getieralb highet scores on all tests ot tiu' tein iks in tin', 
ainlv lU ^Miuislent will) the il-i o| ti wu 'impT i* 

I eiK I s set I able ’• 



C!ontribuiion of Ciaicgorical Variables Bevond Initial 
V ariable Set 
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Mean Differences for (icndcr and Ethnic C^roups on \\ riicr’s 
\\ orkbcnch Style Variables 
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Standard Deviations for (iender and Kthnic (iroups on 
W riter’s Workbench Stvle V ariables 
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numlxT ot loui; wortU ,inJ Hispanic c\.imuu'(.s rlu' 
tcuest; the percentage ot content words was greater tor 
white and Asian examinees; Hispanic examinees used 
the largest numher ot "to he” verbs and Asian exami- 
nees the tewest: Hack examinees used some what tewer 
adverbs than the other ethnic groups; black examinees 
tended not to begin sentences with conjunctions; and 
Asian examinees tended to use more abstract expres- 
sions than the other groups. 

Table 14 presents correlations bet\\een the W ork- 
bench variables and holistic scores, CieneralKx it is seen 
that these variables tend not to correlate well with holis- 
ticscores. The highest correlation in the table \ .M) is be- 
tween the holistic scores for 1 lispanic examinees and the 
percentage of passive verbs used b\' those students. 1 he 
second highest correlation in the table is between the 
holistic scores for black examinees and the percentage 
of sentences begun with verbs 1>\ those students. It is 
not clear what meaning, if an\, these C(UTelations haw. 

Analyses of Exemplars 

In these exphiratory anabses, exemplary essa\s of three 
types were identified: (H those with extremely high 
scores, (2) those with higher sciires than predicteLl by 
the regression equations Llevelopetl, and those with 
significantly kwver scores than predicted by the regres- 
sion equations. Three essays of each t\ pe were identified 
and these are included in this report as Appendix IX 

Essays with Highest Holistic Scores 

These essa>s demonstrate that it was possible to recene 
a high sctH'e e\en though many of the suggestions de- 
ri\ed from the pie\ious aimUses were not lullowed. 
C.ase receiwd 2o of the possible 24 holistic score 
points, indicating thai only one of the four readers ga\e 
It a score of less than the maximum of E. And \ et Case 
is an essa\ about a \er\ personal expeneiiee, is not 
m standard essay format, and has no literary references 
or quotations. It received tlu* highest possible ratings for 
thesis, ideas, and support. This essa\ has a dramatic in- 
troduction and vividly Llescribes an experience ot a high 
school drum major being attackeLl following a liome- 
eoniiin; football game b\ a fan of the opposing te.im. 

C ase 44 receiwd 22 of the possible 24 holistic score 
points. This essa> is also about a personal expefieiKe, is 
not m staiulard essao fonn.it, .iiul contains no hterar\ 
lefereitLev ( >r quiJtations. It receweil the highest possible 
Mtmgs lor thesis, straieg), uleas, support, and tone, 

( X the till 'ee highest si^oring essa\s, ( ase SO is the 
onb tme th U follows the suggestions tleiueil lioin the 
pre\ ii UN .inab ses. Its content i > about current affairs and 
liNtnrv, It \'^ m st.indard four j^aray.raph ess.o Imniat, 
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.iiid 11 eont.iiiN both literarx refereiiees and quotations. 
It received the highest possible r.iting onb' tor thesis 
st,iremeiit, alrliougli the ratings were \ery high for sup- 
j'XMt, tiaiisilion, tone, and senleiKe \,iriel\. Mils essay 
ixxeixed lm\ marks for sfialeg\ and ideas, however. 



BEST COPY AVAILABLE 



All three ot the highest scoring ess:iys were written 
hy examinees with high SATA' scores: 620, 6S0, and 
590, respectively, and all three essays were well aho\’e 
a\erage in length. 

Essays with Higher Scores than Predicted 

Predictions were based on the regression analyses pre- 
sented in 7\ible 9, excluding SAT-\' and TSW’H scores. 
These multiple-choice score predictors were excluded 
because the objective was to identity essays that re- 
ceived better scores than would ha\e been expected 
Irom the ratings and other data available on the actual 
essays alone. Case S”' received a total holistic score of 
I”', although the predicted score was 12.685. None of 
the ratings for this essay were above average, and a 
number were negative, so we must look elsewhere to ex- 
plain why the total score was better than expected. The 
essay was rated to be in standard format, it contains a 
literary (actually an art history) reference, and it com- 
bines current affairs and histor\’ content. The essay 
demonstrates considerable knowledge of art history, be- 
ginning with the sculptor, Donatello, and later relating 
Donatello's sculpture to Michelangelo's (although 
Michelangelo is misspelled). 

C!ase 121 received a total holistic score ol 1", even 
though its predicted score was onh 15.640. None of the 
ratings of specific characteristics were particularly posi- 
tive (although there was a for ideas), and the essay 
IS not in standard essay format, has no literar) refer- 
ences, and is about a personal experience. It does tell an 
interesting story ot a b(n* who got mixed up with the 
wrong people, but later turned himself around. This 
essay may have evoked sympathy in die readers, and/or 
they may have simply thought it w as a good sior\, and 
that coiikl be why ii recei\ed higher scores than other- 
wise might have been expected. 

C.ase 12"' received a total holistic score of 16, hut 
had a predicted score ot only lOAks^-). Its ratings were 
low , it IS not in standard essay format, and there are no 
literary references. Further, it relates a personal experi- 
ence, focusing on a sister whose brother was a rebel, al- 
w.iys questioning authorit)’, while the sister did not. T he 
author (the sister) explains how her brother taught her 
not to be so submissive. As in the pre\ious exemplar, 
this one mav ha\e receiwd better marks than expi’cted 
simpb because it is an interesting stor). 

Essays with Lower Scores than Predicted 

( ase ^2 received tlie highest possible ratings for thesis 
statement, ideas, support, transition, sentence varietv', 
sentence logic, organization, paragraphing, suhiect/verh 
agreement, idiomatK usage, punctuation, vocabularv, 
and level of diction. It is therefore not surprising (hat 



the predicted total holistic score was very high (24.505). 
Since the essay received an actual total score of onlv- 20, 
hovv'cver, it was classified as having a substantially 
lower score than would have been predicted. The pre- 
dictive error at the extremes of the (.listribution is higher 
than in the intermediate ranges, and this may be one 
reason for the discrepancy. Nevertheless, this essay was 
evaluated as not having been completed, and the rating 
for the conclusion was relatively low. The essay also has 
only two paragraphs, the last of which is rather lengthy. 
VC'hy it received the maximum possible rating for para- 
graphing (from tvv'o different raters) is not clear, since 
the second piragraph appears to need at least one 
break. Two of the readers gave this essay a total score 
of '"6," vvTiile the other two gave It a total score of only 
"4." This reader discrepancy could also explain why 
this essay vv’as sctired lower than predicted. 

Case 180 was predicted to have a score of 15.986 
but actually received a total holistic score of only 10. 
Ratings of the characteristics ('if this essay were gener- 
ally low, with an c'lccasional (sentence variety, para- 
graphing, activ’e/passiv’e). It received a verv- low '"2" 
rating h'lr neatness, however, and it was evaluated as 
not completed. It also has some spelling errors and 
some probably inadvertent in word error usage (“easy" 
rather than 'Axisily" and ^^uir" rather than “are”). Ad- 
ditionally, the essay contains some very awkward ex- 
pressions: “My personal feelings being myself are . . 

“if sc'imeone v\’ere give you trouble left and right . . 
“v\hat makes the one's who turn out bad or inferorate 
bad behavior is a source unkiu'ivv’n." 

C^ase 189 had a predicted score of 12.49'' but actu- 
ally received a score of only 9. All ratings were average 
or below average except for support, which received a 
Ratings for vocabulary and diction were especially 
low. Fven though standard essay format vvas used, the 
essay was not completed. The essay begins fairly well 
with an introductory paragraph and a second para- 
graph that references Martin Luther King and the court 
case ('ll Broirfi r. Bnjrd nj Kduiat'uui. The fourth para- 
graph mentions Hitler hut has some awkward language 
(“Hitler outrageous way to rise to power . . and is 
not developed. T here is no l mclusion since the author 
apparently ran out of tinw. Fven though the rater did 
m»t note a language problem, there mav- have been one. 



Conclusion 

I hese analvses of essays written on a single topic at one 
administration of the l-C.'F cannot be generalized to 
other topics ind other situations, but they do suggest 
some characteristics that influenced the scores readers 
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gave rlie essays written for the 1990 F.C!T. To the degree 
that these characteristics are similar to those identified 
for other topics and other administrations, some more 
general conclusions might he drawn. Table 1:. shows a 
comparison of the strongest correlates with holistic 
scores on the 19*^9 and the 1990 K(T essay topics. For 
both, the five most important characteristics were 
overall organization, use of suppe^rting materials, note- 
worthy ideas, rhetorical strategy, and thesis statement. 
Moreover, the order of importance of these five charac- 
teristics was almost identical in the two HC'T adminis- 
trations. This consistency in results occurred despite the 
fact that 1 1 years had elapsed between the test adminis- 
trations and the fact that different topics, students, and 
readers were involved. 

Of the essay characteristics rated in both studies, 
(werall organization correlated most strongly with total 
holistic scores in the 1^90 administration (.”4). This 
was almost identical to the outcome of the 1982 study 
(Breland dc Jones, 1982} of 19"^9 KCT essays written on 
a different topic. In that study, the correlation between 
total holistic scores and overall organization was r?>. It 
seems safe to conclude, therefore, that organization is 
strongly related to the holistic score an essay receives. 

The second strongest correlate with high holistic 
scores in the present study was the use of supporting 
materials (.^0), and this sanu’ characteristic was also the 
second highest correlate [TD in the 1982 study. INing 
supporting materials seems to be important tor re- 
ceiving high scores. 

The third highest correlate with t(Uai scores was 
noteworthy ideas, including originalitv' oi thcuight and 
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insight. This correlation was .66 for the 1990 topic and 
."0 for the |9“’9 topic, for which this characteristic also 
ranked third. 

Other characteristics that correlated highly with 
holistic scores in both studies included rhetorical 
strategy, thesis statement, paragraphing, transition, de- 
velopment, sentence k^gic, sentence varietv', and tone, 
although these ratings were not derived in exactly the 
same way in both years. The study of the I9’'9 topic 
combined paragraphing and transition in a single 
raring, while the study of the 1990 topic split these into 
two ratings. Development was not rated in the study of 
the 19^9 topic, although it correlated highly (.61) with 
holistic scores for the 1990 topic. 

Correlations w’ere similar tor the different student 
groups in both research efforts, although gender com- 
parisons were not made in the studv' ot the I 9~9 topic. 
For the 1990 topic, lA’erall organization was the 
strongest correlate with holistic scores tor both males 
and females (.“'4 and .”’2, respectiveU). The second 
strongest correlate, use of supporting materials, was 
also near!)' the same for both males and females {.^1 
and .69, respectively). And the third highest correlate, 
noteworthv' ideas, was likewise similar tor both males 
and females (.6^ and .65, respectively). 

With respect to differences between ethnic groups, 
(werall organization showed the highest correlations tor 
all tour groups (.”1, .66, .“*4, and for the Asian 
.American, black, Hispanic, and white samples, respec- 
tively). l‘he second strongest correlate was slightly dif- 
ferent tor the four groups, h(nvever. In the A '.an Amer- 
ican sample, transition showed the second highest 
correlaticm; in the hlack sample, it was use of sup- 
porting materials; in the Flispanic sample, transition 
was tied with support for second; and in the white 
sample, supp(^rt was second. 1 he <.litferences were 
small, how'ever. 

The anah ses for the present study \ ielded some (ur- 
ther characteristics that intlueiiced the holistic seores 
given on the 1990 F.CT essay examination. Thc'se essays 
shenving evidence that the writer had tol lowed instruc- 
ti(ms, and that were completed, used standard essay 
format, contained literary references, and demonstrated 
reasonable proficiency in the Hnglish language received 
slightly higher holistic scores than essays not having 
these characteristics. F.ssays witli content combining cur- 
rent affairs and literature, current affairs and history, or 
literature and history were scored slightly higher on av- 
erage than essays based only on personal experience. 
Nevertheless, some of the top-scoring essays written on 
the 1990 topic were about personal experience and made 
no references to literature, history, or current affairs. 

As observed in previous studies, longer essays re- 
ceived higher holistic scores, on average, than shorter 
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essays. Such an outcome follows, howe\er, from the 
(Hher ratings obtained. Using supporting materials, tor 
example, requires that words be written to explain the 
relevance of such materials. And it is impossible to fully 
develop an essay without writing a sufficieiu number of 
words. Ciiven the importance of these kinds of interac- 
tions, extremek brief essays arc probably \ ery unlikely 
to reeei\e high holistic scores, 

l*he findings of this study, and similar studies con- 
ducted previoiish', are probably not much different 
from what has long been known by F.nglish teachers. 
The brief, impromptu essay examination poses some 
particular challenges for the examinee, however. Ideas 
must be formulated, organized, and then developed in a 
relatively brief period of time. Most examinees would 
probably benefit from some practice, under strict time 
constraints, in writing essa\s of this type. 

Such practice should focus on overall organization, 
use of supporting materials, formulating ideas, <.le\ el- 
oping a rhetorical strategy, making thesis statements, 
essay dewlopnient, approp>‘iate paragraphing, and 
making good transitions betw'oen sentences and para- 
graphs, Although our limited anah sis of one essa\ topic 
suggested that using literary references and a standard 
essa\' format, and not writing about personal experience 
were associated with higher scores on a\erage, these 
factors may not generalize to other topics and ha\e at 
best very small effects on total scores be\'ond the 
stronger correlates identified in this stud)'. 

It seems inappropriate to offer an\- ad\'ice specific to 
different gender and ethnic groups, although differences 
between groups were obser\ed. It is not clear that em- 
phasizing different essa\' characteristics for different 
groups would yield better performances, and such a 
focus could take time that would be better spent tin the 
piincipal eharacierisiics associated with high scores. 
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Appendix A 



Essay Topic and. Instructions 



ENGLISH COMPOSITION TEST WITH ESSAY 

Part A 

Time — 20 minutes 

Yo)J have twenty minutes to plan and write an essay on the topic assigned below. DO NOT WRITE ON 
ANOTHER TOPIC. AN ESSAY ON ANOTHER TOPIC IS NOT ACCEPTABLE. 

'fhe essay is assigned to give you an opportunity to show how well you can write. You should, therefore, take 
care to express your thoughts on the topic clearly and cfTcctively. How well you write is much more important 
than bow much you write, but to cover th^: topic adequately you may want to write more than one paragraph. 
Be specific. 

Your essay must be written on the lines provided on the answer sheet. You will receive no other paper on 
which to wnlc. You will find that you have enou^ space if you write on every line, avoid wide margins, and 
keep your handwriting to a reasonable size. It is important to rcmeniber that what you write will be read by 
someone who is not familiar with your handwriting. Tr>^ to write or print so that what you are writing is legible 
to the reader. 



Consider carefully the following statement and the assignment below it. 

Then, plan and write your essay as directed. 

"^Outrageous behavior is instructive. It reveals to us the limits 
of our tolerance.” 

Assignment: The quotation implies that those who go beyond accepted 
standards help us to clarify our own standards. Do you 
agree or disagree with the quotation? Discuss, supporting 
your position with examples from current affairs, literature, 
history, or your own experience. 



DO NOT WRITE YOUR ESSAY IN YOUR TEST BOOK. You will receive credit only for what you write on 
your answer sheet. 

WHEN THE SUPERVISOR ANNOUNCES THAT TWENTY MINUTES HAVE PASSED, YOU MUST 
STOP WRITING THE ESSAY AND GO ON TO PART B IF YOU HAVE NOT ALREADY DONE SO, 

IF YOU FINISH YOUR ESSAY BEFORE THIS ANNOUNCEMENT, GO ON TO PART B AT ONCE. 



BEGIN WRITING YOUR ESSAY ON THE ANSWER SHEET. 



Appendix B 

Rating Form and Instructions 



Essay ID Holistic Score Reader ID 

GENERAL CHARACTERISTICS + 

1. Thesis statement (explicit or implicit) 

2. Rhetorical strategy 

3. Noteworthy ideas: Originality, insight 

4. Use of supporting, materials , examples, etc. 

5. Transition, flow, continuity 

6. Tone and attitude 

7. Variety of sentence patterns 

8 . Sentence logic 

9. Overall organization 

10. Paragraphing 

11. Conclusion 

12. Thesis Development 

13. Other 

SYNTACTIC CHARACTERISTICS 

14. Subject-verb agreement, verb forms, etc. 

15. Pronoun usage: agreement with antecedent, etc. 

16. Parallel structure: clauses, series, etc. 

17. Active vs. passive voice 

18. Idiomatic usage: prepositions and phrases 

19. Punctuation 

20. Other 

ERiCif’ 



O i 



LEXICAL CHARACTERISTICS 



21. Range of vocabulary 

22. Appropriate level of diction 

23. Precision of diction, conciseness of phrasing 

24. Figurative language: methaphor, analogy, cliche 

25. Spelling 

26. Other 

Instruct ions 



The rating form is based on a form used in a previous research study of ECT 
essays. It is intended as a means of determining what charac ter i st ics of ECT 
essays are deemed most important by ECT readers. The essays you wirl be reading 
have been randomly selected from the 1990 ECT administration, and holistic scores 
for these essays are already available. Therefore, there is no need to score the 
essays holistically'. 

In the uppei left-hand corner of the rating form is a space for the essay 
ID. A1 though there is more than one identification number on the essay response 
sheet, the ID to be written in this space is found on the reverse side (page 3) 
of the essay response sheet. This is an oight-digit num.ber printed vertically in 
the upper -left hand corner of page 3. 

In the ui'^por right-hand corner of the term is a space for reader 
idem i hear ion . V.’rlte your reader number in this space. 

The ft-tm :ists a number of ossay characteristics oi: the left side. bote 
: i;at Mime ai e s.paco.s t.o write in "other" charac t or 1 st ies lliat y'<vu may (cel aie 
important but are not adeguateiy described by the charac ter i st ics listed. Please 
write in any characteristics that you believe to be important for a particular 
es.say but '.vhich are not listed. 

On the right side of the form are four columns and spaces for placing check 
m.arks for an essay that you believe to be especially weak weak {-), strong 

(4), or especially strong ( + +) on a character 1st i c listed. If a characteristic 
is neither strong nor weak, but about average- leave the spaces to the right of 
that characteristic blank. Please do not place check marks in between spaces. 
Except for very lu. iel CoOr^ys, it v. i 1 1 be useful if y-;>u identify at loast 10 

character istics tor each essay that you believe to be either weak or strong. 
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Appendix C 

Supplementary Ratings 

Supplementary Rating s 



1. Neatness ( 5 - superior, 4 « above average, 3 - average, 2 « below 
average, 1 — very messy). 

2. Legibility ( 5 - superior, 4 - above average, 3 - average, 2 - below 
average, 1 - unreadable), 

3. Were instructions followed? (1- yes, 2 - no). 

4. Was the essay completed? (1 - yes, 2 — no). 

5. Does the examinee appear to have a language problem? ( 1 - yes, 2 - no), 

6. Does the essay follow a standard 4 or 5 paragraph theme format? (1 - yes, 

2 - no) . 

7. Does the essay make reference to literature? (1 - yes. 2 - no). 

8. Does the essay contain a literary quotation? (1 - yes, 2 - no). 

9. Does the information in the essay appear to be accurate? (1 ™ yes, 2 - 
no, 3 - cannot be determined). 

10. Are indentations made where appropriate? (1 - yes, 2 — no). 

11. What is the content of the essay material? (1 - current affairs, 2 - 
literature, 3 - history, 4 - personal experience, 5 - current affairs and 
literature, 6 - current affairs and history, 7 - literature and history, 

8 - literature and personal experience, 9 - no distinct content). 

12. How might this essay be classified as to type? (1 — opinion, 2 - 
didactic, 3- political, 4 - entertaining, 5 - polemic, 6 personal). 

An opinion classification means that the essay expresses the writer’s 
opinion about the essay topic. Didactic essays attempt to teach the , 
reader about the essay topic. Political essays turn the essay topic into 
a political argument. Entertaining essays serve mainly to entertain the 
reader. Polemic essays argue against the topic of the essay. Personal 
essays focus on the life of the writer. 

13. Does the examinee indicate a political orientation? (1 - yes, liberal, 2 - 
yes, conservative, 3 - no). 

14. What handwriting style was used? (1 - cursive, 2 - printing, 3 - cursive 
and printing) , 
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Appendix D1 

The Three Highest Scoring 
Exeinplars with Analytical 
Ratings and Other Data 

ECT 1990 
CASE 375 
BATCH 7889 



I flew headfirst into Che side of the car. My head was spinning, m.y hands 
were shaking. I wasn't quite sure what had happened. I looked o-. er my shoulder 
and saw a kid -with a big smile on his face, he was -Surrounded by what I assumed 
were his friends. They were encouraging him, shouting, "Get him .i^ndre ! " and, 

"Do it again, mtinl" 

It was the night of our Honecoming football game. Vou know, that hallowed 
and revered event, when if you don't win, you lose your first-born child or 
something like that. An>m;ay, I was Che drum major of our band, we had just one 
a closely contested game, and since I was wearing a pure white uniform, I ■••.as 
easily singled out by irate fans of the opposition. They v.'ere upset and wanted 
CO rumble. I happened to be in che .-vrong piace at t ne wrong timie. 



Andre stepped up to me, very close this time. A familiar taste became 
reacquainted with my tastebuds, the taste of adrenaline. My head 'was pounding, 
T sav; a face surrounded by dots, bright lights and flashes in front of me. I 
knew it was corninci ije<c.;e it hi! m<- . Hi;; h.'it connoclcd with :r,v lower jaw and 
split m.'/ lip. I felt and tasted the warm, blood in my mouth. The small crowd 



had ga ulcered v;at.ched me 
r n e d a nd wa Iked av ; ay . 



some sort 



react i on 



ih: s 



IT. ageous ac 1 1 on . 



V’e are constantly being confronted v.u.th events, ac,*., ions, happtrn-u-.gs , etc. , 
that test the standards we hold. That night 1 'was confronted, and I realired 
that lowering myself to the immature and barbaric standards of Andre was just 
n.ry wc'rth ; . I t.old myself I was better than that, as indeed I air;. But other 
is.sues challenge us on a national level, American flags are burned on capito: 



c teo.s , ol'^HC'or.c m .is i*: .1 yi i cs ai e s<* Id in 'at. • >i v:- , iwOt ni g r cip*i ^ c n 
qalJery walls, and great debate is spread nationv.vde. 
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ECT 1990 
CASE 44 
BATCH 7723 
SERIr^L 0u64 



I agree v;ith the implications of the quote ''outrageous behavior is 
instructive. It reveals to us the limits of our ov/n tolerance.'' In other words, 
seeing someone else do something v;hich is outside the norm may help us to better 
d efin e our own n o r m . 

One incident which did this for me occurred during my freshman year in high 
school . My English teacher v;as not v;hat you would call the quickest person in 
the universe. In fact, she was pretty stupid. So of course, the kids took 
ad\^antage of her. They'd walk in late, and if she asked them why they v/ere late, 
they'd sa^', "My bus got caught in traffic." This was a fifth period class. 

LT if they hadn't 'written a response log to the reading we w'ere supposed 
to have done, they'd turn in their French homework instead. They always got a 
10 {except the one guy who tried to give her his Japanese hom.ew'ork. She 
noticed that i . 



Mov;, I'm. nit sa*ying that I v;as a perfect student or anything, but I 
sometimes thought that people 'went a little too far with things. I never really 
r:ad a dehnite i:ne befween "okay" and "not oka'^'", it w’as just a vague sort of 

Tn.til or.e day, about 2 3 of the v.’ay through the year, a gu^* v;ho sat in the 
back oi the room, really took a fitting leap into the land of not-okay. 

It started with some kind oi aigumenc about v;hv he was late every day, I 
*. hin.K, I '.'.‘asn't paying much attention at hrst, but hnally it escalated to the 
poin.t where everyone in the room W’as watching. It seemed clear that the teacher 
didn'^ reall’y '.vant to argue about it, but the kid was really mad. V/hen the 
r_ OLicn>. r ni::. C'alm.^\' ’ t cit down, r:e said, "Mo you stupict 

b a s k e i. b a 1 1 ’n e a d . ‘i o u s u c k . " T h e n h e '.‘/a 1 k e d o u t. . 

V.'e i . rk-r mv. "h els- happened in clas.s that day, and the next day the kid 
was back in class like r.-.-thir.g had happened. But for the rest of the year, 
tr.Mu y::-. .iy wa.s m.-.ii:: nicer to the teacher, and I decided never to take advantage 
of h.or not -sc'-sv.’i f t ness again. The kid in the back of the class had shown us, 
better than v.’e could .show ourselves, the boundary betw’een acceptable behavior 
cii'. a " f ai ._'‘_*y Tid an.yt ning j. wC'Uili e'.^tr i y oc* . 
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CASE 80 
BATCH 7740 
SERIAL 0:37 



Outrageous behavior helps us to identify our ov;n standards of tolerance. 
This has been shov;n to be true throughout history. In both fiction and reality, 
the cot'.cion huitan standards of ttlerance are not truly kncv.n until someone else 
pushes their, their outexmosL T.vl- tjxaiupl e'S-ci-r- — t-hi-s-'-cnn-rlosoplny-— a-r-.-r --vradciami- 

Hussien, and President Ricliard Hixon . 



The Middle East Gulf Crisis has been exemplary to th.e tolerance idea. A 
crazed and pov;er hungry man on the other side of the globe decid 6 *s that ho i.s 
vgoing to .see hov.' much fu s ov.t. pov.'er can gain him. After several attempt.^ to take 
over lands that he claims are his, ot-het ccjuntries have draicn the line ot 
tolerance. The United dtales for example, v;as slowly fallir.g into the bciiet 
ti'iat rfiilitary arms and i nf or fo-ncrii v.'orf * nc't needed anyruoi e in the huge 
quantities of year.s past. The crisis in the middle east has taken that belief 
av.'ay. Hov;, more than over, our tolerance, as a nation concerned with the welfare 
f. ! ■vtiters. has. shov;n throuah the Mnit‘ d (,'an UL't a.. 1 l*w or.»‘ man to 

*^C‘^>n'>rr. i ca 1 1 7 * plug rhn wot Id. T.ve entire oil supply' ot most of the mtajor 

r i f'-s ic endangered, the c . .7 . simpTy cannot stand for it. The actions taken 

as a nation, along with i.he troops and weapons that hat'e been sent over, clearly 

exempli f\' that the tolerance level for tills kind of action is very lov.u The 

United .States v;ould have never knov;n how far to let this t^^pe of crisis go, until 
• h*' ih-- l.r.e one step t c tar. 



t_- 1 C‘ u t r a g e c> u b e t . a i 

r e.^ i den 1 1 a .. pov,*e r s <■: inu vr 1 c • i u 



i-n-z: of the past p- i'ient a of nation is another example 

H e *.*.‘a n t e^ >: i ’ c> u 1 ; e .* 1 1 i < ' ■ '// r i c c n c t i t u t i > > n a 1 1 y g r ' a r 1 1 e ^ i 

aeifi t his o'wn benefit. Mo k-* her pM-*s i *dr*rif in 

“UT histnry had epone as far as pushing th'Se s-icrcci pov;err« intc‘ ^u'irne and scandal 
as he did. Althuugli .t wa.:. a negative exp.^rienie nr : he country at the time, 
.-'.•■'•.Tja ' — I H<=> '* n "i oT-rr run. His outraoeous behavioi' set the limits 

1 ! o‘'W-'r, "hr 'uuh M.*- t.any iav;s 
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Appendix D2 

Three Exemplars with Higher 
Holistic Scores them Predicted 
with A7ialytical Ratmgs and 
Other Data 

EOT 1990 
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BATCH 7':’ 4 2 
SERIAL 0092 



Oucragecus behavior has been sho;^Tl by time to be instructive. Usually 
radicalism is taken as offensives by the exiting conservative majority. These 
radical ideas are usually arrived at fromi the discovering of some nev.^ and 
shocking knowledge. The shocked conservatives rebel against outrageous behavior, 
then as they learn about it they come to tolerate it and finally accept the 
radicalism in part or whole as normal. 

.'\lv;ays in time outrageous behavior has been persecuted or attacked by the 
conservative m.ajority. During the Renaissance, the sculptor Donatello, with his 
sculpture or David shocked art circles. The average person found the sculpture 
of the nude outrageous. Until then the church was the main subject of artistic • 
ventures. .Art for the sake of art was a nev; and unusual concept shunned by most 
except for the Medici family who commissioned the v;ork. 

The attributes of the outrageous behavior of an individual or group would 
eventually gain understanding and acceptance within the conservatives. The 
morality of the free-standing nude v;as at first shocking. As the renaissance 
pr^'-greosed other.s came to respect Donatello for his work. This work influenced 
later sculptors and painters. Michealangelo wuth his sculpture of David show^s 
hcv." the outrageous gained respect within artistic communities. This outrageous 
action of one artist later became a convention. 

Mot only in art is there a tendency to isolate radicalism. In our ov.ti 
times, Rock N' Roll music was censsored or banned as lev/d. It has now’ become the 
standard of popular music. It like the use of art for the sake of art was at 
once a radical idea v/hich gained respect among its critics. Its influence then 
changed outrage to convention. 
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Those who exceed standards help others to clarify their own standards. 
Whether their actions be good or bad, this statement is true. 

Coming from a family with strict and somewhat old traditional ways, I can 

" relate to-t-he—statement-of— exceeding standards. As- a -young boy -o-f- -the sixth-- — 

grade, I grew up with the wrong crowd. These people I "tagged around" with were 
labeled best as the rebels. They were Lough guys v;ho wanted to grow up too fast, 
too soon. I watched and observed them. They cussed, stole, fought, etc. with 

other kids which, in their eyes, got them the respect and acceptance they were 

wanting. Their actions had caught my attention and that little attention they 

recieved from me had caught their eye. They asked me to be one of them. I felt 

proud and honored. They made me feel special. 

As weeks went by, I got the reputation of my new found friends. I hadn't 

really done anything but tag along with them. One day v;e all saw a little kid 

selling candy from house to house. We knew he had money so we decided to take 

his money and candy. Doing this miade my friends feel tough but all I had gained 

v;as a guilty conscience. I realized my situation and felt bad for the kid. I 
felt even more sorry for my friends knowing that they are going through life as a 
game and they were losing. 

Their actions of exceeding standards caused me to think of "how far should 
this go." Others exceeding standards do help others clarify their ovm standards. 
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My brother was always one who vjouldn't conform to the accepted norms of 
society. He always wanted to question authority and its foundation. At the 
tender age of five he would always try my mother's patience. Whether it was 
playing too rough or not following his teachers orders, he made it very difficult 

f o r my paren ts —to c on trol— h im^^ ^ ^ My_^ par enhs_ thoughts it . was ■,.„j.us.L ^ a^ phas e_._ t ha^t . ^h,e 

w^ould grow out of. 

Imagine their surprise when he was sent home t arly in high school when he 
refused to do his science lab. Not only were my parents outraged but they didn't 
know what to do with him so they came to me for advice. I v;as a couple of years 
older than him and was the exact opposite. I was furious because of his behavior 
and just thought he did all these horrible things because he wanted attention. 

That night, I v;ent to his room to ask about what had happened earlier at 
school. We talked for a little over an hour. In that hour, I found out that 
his actions were deeper than I had imagined. He questioned authority so he could 
define himself. He wanted to ask why things are the way they' are instead of just 
accepting them like I had been. I went to my room and thought about what he 
just said. He had not only defined himself, but also me in the process. By 
being opposites, he had shown me that my standards were different and that I 
shouldn't just accept everything that I was told. 
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Other Data 
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V’hen a person is seen doing something outrageous, some people laugh and 
cheer while others smirk v;ith scorn. VJhether with admiration or disdain, almost 
all of the observers judge the person to some degree. These people are 
unconsciously applying their standards to this person. The person's behavior may 
or may not effect a change in the audience's standards, which are also affected 
by observation of others' reactions. 

I myself can understand this type of thought process because I have used 
it in a recent experience. This past summer, I participated in a five-week 
academic program. I was initially intimidated by the vast number of strange 
faces. This soon changed, howeve.', as I met some very outrageous people. One 
guy stole pylons from a construction site and put them in his room. Another 
fellow kicked a hole in a wall and poured pepper in the halls. As I observed 
their actions, I thought they were funny. I know that they were doing things 
that are wrong, but I admired them for their rebeliousness and I soon began doing 
destructive things like them. My most memorable action was the blackening of an 
elevator. As I look back on these events, I can now see how others' outrageous 
behavior caused me to change my standards and also my own behavior. 1 was able 
to put aside my disdain and to appreciate the ridiculous humor of their actions. 
This change in me v;as partially brought about by the fact that other people also 
seemed to appreciate the deeds. In one sense, I can say that I altered my 
behavior to gain the approval of others after I realized their standards. In 

actuality, I do not approve or disapprove. 
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When dealing with society's "outrageous behavior," I (along with many 
others) find that you actually do reveal how far your tolerance will take you. 

You see, there are so many individuals who in this generation mastered or 

concep ted” the±r~ ov/n~l’i-n.e~of"-marads'”and~inveh:ted a^new -se t— o f values-: It" Is sd'-' -- 

different from the "old fashioned" days so to speak, that critics (you and I) can 
easy point the finger on today's generation in America. 

Now and then I let my mother get her ten cents worth of thoughts by 
telling me that today kids our the worst. She's always preaching how we've 
somehow lost respect for elder's. My personal feelings being myself are, v;ere 
taught and given the values and manners of our parents and what makes the one's 
v/ho turn out bad or inferorate bad behavior is a source unknown. 

Although, no matter if you are a child, a teenager, or an adult all of our 
limits will only take us so far. Both you and I know if someone were to give 
you trouble left and right, we only would put up with so much. Being older is 
doing it easier, because you have "earned" the right's, of respect. Being young 
will take its time, but no matter what society will always have it's troubles, we 
must learn to cope v/ith it regardless. 



ECT 1990 
CASE 180 
BATCH 7800 
SERIAL 0352 



TOTAL HOLISTIC SCORE 
PREDICTED SCORE 
SAT-V 

tsv:e 

SEX 

ETHNIC LANGUAGE 

THESIS 

STRATEGY 

IDEAS 

SUPPORT 

TRANSITION 

TONE 

VARIETY 

LOGIC 

ORGAInIIZATION 

PARAGRAPHING 

CONCLUSION 

DEVELOPMENT 

SUBJECT/VERB 

PRONOUN USAGE 

PARALLEL STRUCT 

ACTIVE PASSIVE 

IDIOMATIC USAGE 

PUNCTUATION 

VOCABULARY 

DICTION LEVEL 

DICTION PRECISION 

LAInFGUAGE 

SPELLING 

NEATNESS 

LEGIBILITY 

I N STRUCT I OHS 

COMPLETED 

LANGUAGE PROE 

STANDARD FORM 

LIT REFERENCE 

LIT QUOTATION 

ACCURACY 

INDENTATIONS 

CONTENT 

ESSAY TYPE 

PvOlttical or 

HAMDV.’FITTHG 

WORDS 

P /i RAG RA r H J 

PAGES 



10 (R1 = 2, R2 = 2, R3 = 3, R4 = 

13.986 

340 

34 

FEMALE" " ~ — 

HISPANIC /ENGLISH FIRST L.AiNGUAGE 
6 
6 
4 
4 
6 
6 

4 

6 



5 

6 
7 
6 
6 
7 
6 
6 



5 

5 



1 Eb 

NO 

MO 

NO 

UO 

NO 

L*OT DETERMINABLE 
YES 

PERSONAL EXPERIENCE 

OPINION 

NOME 

pRirr: :i;o 



3) 




Er|c ^4 




1 . 1 n 



ECT 1990 
CASE 189 
BATCH 7804 
SERIAL 0064 



In certain cases, I agree that those v;ho go beyond accepted standards help 
us to clarify our ovm standards. But ' sometimes outrageous behavior is not 
acceptable. In this essay, I v;ill try to support my reasons why outrageous 
-behaviar- is -some time-favor able^-a-nd- o ther--t imes— unf a vorable-. 

First, I v/ill give examples to support the quotation. Imagine, if we all 
v;ere satisfied v;ith the conditions in Nev; York City then I think it is ridiculous 
to believe. Someone must speak up and lead the people to make it a better place 
to live in. For an example, in the 1960 's, Martin Luther King rebel against 
discrimination of black people. Then I believe that this action was necessary 
for the benefit of the people. Another example v.^as the court case Brovvn vs. the 
Board of Educat ion . The action to challenge the government for what is right and 
wrong help change our standards. Thus, it is acceptable. Another example is 
v.'hen the teacher makes mistakes, it is our responsibility to question the 
teacher. If no action was taken, then the students will learn the v.^rong things. 

Second Iv^ I v.'ill discuss v;hy sometime it is not acceptable. 

Hitler outrageous way to rise to power v;as an evil intention to the world . 
The use of force and aggression to gain territory and powers will only upset the 
people. Any from of retaliation and selfish acts can not be justified. 
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